Boosting Kernel Density Estimates: a Bias Reduction Technique?
نویسندگان
چکیده
SUMMARY This paper proposes an algorithm for boosting kernel density estimates. We show that boosting is closely linked to a previously proposed method of bias reduction and indicate how it should enjoy similar properties. Numerical examples and simulations are used to illustrate the findings, and we also suggest further areas of research.
منابع مشابه
The Relative Improvement of Bias Reduction in Density Estimator Using Geometric Extrapolated Kernel
One of a nonparametric procedures used to estimate densities is kernel method. In this paper, in order to reduce bias of kernel density estimation, methods such as usual kernel(UK), geometric extrapolation usual kernel(GEUK), a bias reduction kernel(BRK) and a geometric extrapolation bias reduction kernel(GEBRK) are introduced. Theoretical properties, including the selection of smoothness para...
متن کاملKernel density classification and boosting: an L2 analysis
Kernel density estimation is a commonly used approach to classification. However, most of the theoretical results for kernel methods apply to estimation per se and not necessarily to classification. In this paper we show that when estimating the difference between two densities, the optimal smoothing parameters are increasing functions of the sample size of the complementary group, and we provi...
متن کاملL 2 Boosting in Kernel Regression 1
In this paper, we investigate the theoretical and empirical properties of L2 boosting with kernel regression estimates as weak learners. We show that each step of L2 boosting reduces the bias of the estimate by two orders of magnitude, while it does not deteriorate the order of the variance. We illustrate the theoretical findings by some simulated examples. Also, we demonstrate that L2 boosting...
متن کاملKernel Density Classification and Boosting
Kernel density estimation is a commonly used approach to classification. However, most of the theoretical results for kernel methods apply to estimation per se and not necessarily to classification. For example, in estimating the difference between two densities, we show that the optimal smoothing parameters are increasing functions of the sample size of the complementary group. A relative newc...
متن کاملBootstrap Bandwidth and Kernel Order Selection for Density Weighted Averages
Abstract: Density weighted average is a nonparametric quantity expressed by expectation of a function of random variables with density weight. It is associated with parametric components of some semiparametric models, and we are concerned with an estimator of this quantity. Asymptotic properties of semiparametric estimators have been studied in econometrics since the end of 1980’s and it is now...
متن کامل